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AJSSTRACT 

. There is current ccrccem about the quality of Navy' training. This is best exemplified by 
the current debate over the" adequacy of "self-pacing* in Navy training courses. Navy training 
programs suffer frogi a variety of problems, and these contribute to uncertainty about how to 
manage various training " situations. All o^ these problems and uncertataties interact. To 
blame declines in the quality of Navy training on any single factor, such as 'selfrpacing,' 
would be an ovcrsimplificatipa. This paper illuminates some "perceptions* rurrounding self- 

-pacing in Navy training, ejiplorcs some -realitisaT of Navy training, and presents a recommea- 

' dation about how best to proceed. The paper concludes that: 

' * " 

1. Self-pacing is misunderstood. , • 

' • * 2. Self-pacing is not the only factor responsible for perceived declines in the quality 

^ of Navy training, and may not be invofVed at all. * 

3. Navy trqinins courses have more serious problems than theit method of delivery. • 

4. Traditional delivery methods will not guarantee instructional quality. 

. 5. All forms of dclivery.nincluding self-pacing, have advantages and disadvantages that 
» involve complicated trade-offs. . , ' 

,6. J There are no simple solutions to the problems of Navy training. 

t 

^1 Recent guidance fr-oih the Chief of Navi^l Education and Training fconcerning how to 

proceed is well conceived. Any attempt to -*fect major changes in existing instructional sys- 
tems without the controlled test and evaluation caUed for by CNET would be both reckless 
and costly. Specifically," changing a •burse from' lock step to self-paced or from ielf -paced to 
lock step without sufficient evidence that the quality of thp instruition will improve and/or 
significant cost savings will occur would be counter to CNET's reasoned guidance. 
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• " * ■ EXECifriy^: summajiy " 

" There iicurr/nt concern abqut the quality of Navy trtJiniDg.' Thisjs best cxetnpliaed by 
ttte'curreat debate over the adequacy of "self-padngT in Navy training courts. Navy training 
progran^s suffer from i variety of problems, and these contribute^to uncertainty about how to 
manage various traiiiing situations. All of these problems and uncertainties interact. To 
blame declines in the quality of Navy training on ?ny single factof, such as self.paang. 
v,'om be an oversimplification. This paper explores the following "perceptions' and 'realities 
surrounding self-pacing in Navy training. ' ' , * 

PERCEPTION: Self-pacing is an /optimal method for delivering instniction. and should be 
used as widely as possible in Navy training. 

REALITY: ' When a careful requirements analysis has indicated that self-pacing is 
appropriate fDr meeting a particular training need, then ^elf-pacing should be 

reoocrjnended. The same is true for any othef method of delivery, in^Ittdia^ ^ 

/ traditional "lockstep^struction;. the tradeoffs arc complex^jjtfSy often 
involve achieving cost avoidances or management or scheduUn jf^ficienacs at 
the cost of some unknown effect 6n student learning. ^ 

\ * • • •* ' ' . > ' ■ 

PERCEPTION: • Individual^d Instruction is the same thing as self-paced instruction. 

REALITY: - Self-pacing is only one form of individualization, and may not always be the 
best method. Instruction may be given on an mdmdual basis, but be pa^ed 

• • . ' , by an instructor or a computer. , gven in "group-paced" classrooms, instruction 

might be given it different ways to different students,. 
» "■■ " ■ ■ " 

PERCEPTION: In self-paced courses students manipulate the system to stay in school longer. 
REALITY: This may b^ true fo'r a feV students, howefe.r, all the"research studies that 
• have compared lockstep and self-paced instruction have shown that students 

• generally complete self-paced courses 15% to 20% faster than they do compar- 
'able lockstep courses (Orlansky & String, 1979). 

V ' ' . • ^ -. - ■ \ 

PERCEPTION: Self-paced instruction is of poor quality. 

REALITY- Research has sho,wn that vhen individualized courses-are compared with trad- 
' itional "lock-step- couries, t ley save considerable time "with students achieving 
the same or slightly better school performance. For example, in conipansons 
done in 48 miUtary training courses, achievement in Individualized courses 
was equal to that of conventional courses in 32 cases, superior in 15 cases, and 
slightly poorer in only one case (Orlansky & String, 197J^. • / 

The 'general rule is that when self.-p'aci^g is used to deliver poor training 
materials.or when self-pacing is implemented jJoorly, then poor training 
results. The same is true»of any other method of delivery. 

* PERCEPTION: Self-pacing i$ responsible for the poor quality of graduates from such courses 
PCRCLPTlucs. ^'^^^^p^5.^^ Engineering, Radi6man "A", Basic Electricity/Electfoniqs 

(BE/E). ' . •• . . ' 

REALITY: Self-pacing hns been blamed for ttie'poor quality of several iN ivy training 
coufses.^ fn nearly all of these, the real culprit is not.self-paang, but some 
other combtQation of factofs such as poor training materials, sloppy imple- 
mentation of the training program, or failure to prepare instructors to manage 
student learning. It is unlikely that changing only the method of delivery of 
any current course will risCilt in signiflcant improvement. 



PERCEIO'ION: Self:p^idQSftUn»inatc$ the. need for instni^^^^ 

REALITY} One may find example)^ of very brigit and 'highly -motivated^Kary studsr.ts 
performing welVwUbout an iftstnidtor. but this is certainly not a generalijable 
* rule. Instructors should play an important* role in "sclfSpiccd' instruction, 
, and actually should pace it themselves. .. ' ^ . 

PERCEPi'ION: Graduates' of self'-paced courses don't know 'theory.* 

REALITY: Graduates of most Navy courses, not just self-paced ones, don't know theory. 

The reason is not that some courses are self-paced, bu^ instead, that the 
courses themselves 'd6 not teach ihe theory. The reasons for this state of 
. "affairs have nothing to .do with self-pacing. • 

. * • r 

PERC;EPTI0N: ISD always Results in a self -paced course. . 

REALITY: Self-pacing is not required in ISD. Thp ISD process is a means for definiiig 
training goals, deciding upon the best meaxis of achieving them within 
resource constraints, and providing evaluation of the program. Any method 

• of presentation (traditional, individualiafed, self-paced, or computer-managed) 

. csln be chosen. 



.PERCEPTION; Traditional lockstep instructional delivery results in better Icaftiing and per- 

forxAance. . * ' ]| 

REALITYr - Traditional delivery is no guarantee of instruct iohai^ quaUty or training . 
. efficiency. ' 

PERCEPTION: A poor-quality seU-paced course can be resurrected simply by converting it to 

. "lockstejj" delivery. ; 
REALITY: Because (a) problems^ with self-paced Navy cottrses are due to other factors 
•- than self-pacing per se, and (b) traditionaf delivery doe^ not always result in 
quality, wholesale conversion of 'Self-paced courses to traditional delivery is 
not likely to improve those courses. If no curnculum r^visipns are made, 
then" conversion wili mo<t probably result in a further decrement in quality 
while the courses are perturbed.' _ 

• > 

/ » . ■ - V 

* N . 

Condaslonj .t ' ^ . , ,, V 

1. Self -pacing is misunderstood. - ^ 

2. Self -pacing is not the only fact^ir-^rtspdhsible for perceived decQnes in the quality 
of Navy training, and may not be involved at all. ' ; ■ 

3. Navy training courses have more serious problems than theirmevhod of delivery. 

4. Traditionabdelivery methods will not guacantee instructioilal^quality. ' 

' 5;. All forms of delivery, including self-pacing, have advantages ^nd disadvantages that 
involve complIca:ted trade-offs. . * ^ 

6 There are nb simple solutions to the problems of Navy training. " . * 

! • • 7' ' ^ . 

Recommendation ' 

Recent guidance from the Chief of Naval Education and Training concerning how to proceed 
is well Toncelved. Any attempt to effect -%majdr changes in existing instructiona systems 
withcut the controlled test and evaluation called for by QIET woulrf be both reckless and 
co»tly.- Specifically, changing ^ course from lock step to self-paced or from self-paced to lock 



steo wkhout iutticient evidence that .i.e qu«Uty o( the instruct.'on will Improve and/or 
rilLcao, c«, . vings wiU occur would be counter to CNETi reasoned guidance. 
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^elf-Paced TralcJag: 
*) ' PefcepUons aAd Realities 



Entroductlon ' , • 

There is current concern aboit the quality of .Navy training. This is best exemplified by 
the current debaie over the adeqiiacy of "self-pacing" in Navy training courses.' 

' Navy training programs suffer from an inadequate "stable" of .experts for trailing pro- 
gram design and development, poor analysis of^bn^v match tm.nina to ,ob^ inndeqnate 
prescriptions for deciding how to train, inadw^uate performance measurements, differences m 
-student skill's iad motivation, systemic problems in delivering training courses, a poor acquisi- 
tion mechanism fqr contracto^dcveloped training courses, no sykematifc maintenance ^stem 
for curriculum quality, no effective system of quality control for Navy instruction, msuffiaent 
funding for careful course design and deUvery, shortages of training equipment, shorteges of 
experienced instructors, poor instructor trainmg. and uncertainty about how to manage this 
situation. • • * ' , , 

There is a tendency to searcW tor simpUstic solutions.to these problems. Some in the 
Navy feerthat if we could only return to the traditional instnictor-on-a-podium method of 
instruction then afcwould be well. But jts not that simple. There have been significant 
changes in society"vfcr the past 20 years which have affected the state of Navy- traimng. 
These include transition to the All-Volunteer Force with changes m" the recruitmg pool, 
changes -in public education ^ith differentes in the skills and abilities reciniits bring to. the 
Navy, the "television generation," declining College-Board test scores; the list goes on and on. 
There have been changes in the way the.Navy develops, delivers, and manages training. These;, 
changes occur at a time x)f radical technological change and growing com.pl«mty in the Navy 
and society in general. 

' All of these changes and conditions interact. To blame declines in the quality of Navy 
. training on any single factor, such as Vlf-pacing." would be ri» oVersimplificjition. It would 
be like\lamiag our failure in Viet Nam on having the dnift>stead of the all volunteer force. 
Yet. the inibiltty of Navy electronics te»i»iv ans to repair radios is beiAg blamed on self- 
pacina in the BE/E course even though- the course content is basically the same as it wa5 
before the course was self-paced, and even though scvcfral montl^ of additional trammg are 
-given between BE/,E and fleet assignisient. 

The purpose of this paper is to illuminate some of the "pc^cep'tiqns" surrounding self- 
pacing in Navy training, to explore some of the "realities" of the current state of Navy train- 
ing, and to present a recommendation about how best,'tb proceed. 

PERCE??riON: Self-pacing is an optimal method for delivering instruction, and should be 
used as widely as possible in Navy tx;aining. ... 

REALITY* When a careful requirements aniaJysis has indicated that self-paciAg b. 

appropriate for meeting a particular training need, then self-pacing should be 
recdmmended. The same is ttue for any other method of delivery, including 
traditional'lockstep" instruction. * ^ . 

For example, lockstep instruction is very well adapted to recruit' training. 
, . apprWicetraining(SA..FA. AA).an'd training for sopar or ClC^teams. In 
general, lockstep instruction is appropriate for tralnina^inVolving the develop- 
mint of team dr unit skills. Y * - 

Self-pacing is not' 9 panacea, and educators have n^yer claimed t«at it was. 
* * * There are. a variety of problems with self-pacing which somfttimes limit its 
•■' usefulness an4 which must be properly understood before a decision is made 
to implement it. These .problems can include Jkjot student motivation, poor 
student and instructor opinion, inability of students to manage their study. 



and scheduling compUxity. ^ ' , 

Educ^n generally adv'ocate some (om%f individualized instruction, but not 
nccc-mrily self-pacing. However. Individ uaiizsjJ" training including self-pacing • 
can provide several benefits in Navy schools. These benefits include the fol- ■ 
lowing; ' . ' . • 

1. Individualization can provide a reduction of 15% to 20% ii^ time to com- 

pfete a course (Orlanskyi String, 1979)^. . 

" 2. Individualized courses can reduce the idle. time that qfcurs when students 

complete one course \\x lucu umuiug ^^-w^— m — — * — ^ " 

ing of a following course, because courses ^an "convene continuously. ^ 

3 The continuous convening of an individualized course, also proviclts greater 
>ccs3 to ichobls. ^.Convening iates of^lock-Stcp cqut^cs often fall at tinri» 
^when students are unavailable because of ship assignments or other 'job 
duties, S^l'f -paced courses are available whenevfcr a student ca^ be spared. 
4. A seft'Study approach appears particularly apptopriate for mainteifince- 
^ oriented courses, because these typicaUy require a studenf to leam to use and 
interpret technical manuals and, other job-aids. For these courses, the self- 
itudy is of ten more job-like than a conventional lecture, and should .have 
gifeater probability of transfer to the actual job situation. 

' 5. Individualized'courses may be more easily trynsfcrrcd to rcnwte-sitft use, 
assuming that any necessary laboratory equipment is available. 

. : 6.* Individualized courses ^rfc in a sense available off-the-shelf. If greater 

* throughput of a course is required, this can bp accomplishfed without a.ccn- 
ccmitant increase in the number of experienced instructors required. ^ 
The point of all this is that there is no easy answer" to the question of whether 
or not to self-pace or indivfdualize a cpurse'. The- trade-offs are complex; Ihey 
often involve achieving cost avoidances Oi- management or scheduling* 
efficiencies at the cost of some unknown effect on student learning 

PERCEPTION; Individualized Instruction is the same thing as self-paced instruction. 
REALITY: . Self-pacing is not alwayi the b«t method of individualization. Instruction 
• may given on an individual basis, but be ,jaced by aib tnstructor.or ajom-^ 
outer. For example, in pilot training, instruction ^ is often highly mdividual- 
. ized. But,' it is not paced -by the student, but father by an experienced 
instructor. Likewise. mod<m computer-based instructional programs usually 
require the student to iiiteract heavily with the material to be learned.-^and 
the computer program determines th^ rate and flow of the instruction. Even 
, 'in "group^paced* classrooms,, instruction might be, given in different ways to 
different students. ' • ' ♦ ^ 

Rese^ch On '.learner control of instruction* generally, shows that students are 
not good at determining what, how, or ^low fast to study. This liads to the 
: conclusion' that* self-pacing may not be the best method of Individualization. 
• Research also tends' to show that more mature learners can handle self-paced 
instruction better than novicei. or Recruits. Foy this reason, self-paang is 
Of tei* effective in advanced Navy "C* and T schools or in. certain Officer 
V • training programs, even though it may not work in large preparatory or A 
. , schools. ' ' . 
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PERCEFflON: In stlf-paccd courses, students "manipulate the system" to stay in school 
longer. 

RkLALITY- ■ This may be true for a feW students, however, research studies that have com-; 

' pared |«:kstep and self-pac^ci instruction have shoft-n that students complete 
self-paced courses 15% to 20% faster than they do comparable Iqckstep 
' ' courses (Orlaasky & String, 1979). If students are manipulating the system 
' they are doing a poor fob of it. . ' 

PERCEPTION: Self-paced instruction is of'^oof quality. ^ • ^ 

REALITY: Research has shown that whenindividuali2ed courses are compared with trad- 
itional "lock-step" cou-rtes, theylave cOosWerable time with students achieving 
the same or slightly better school performance. For example, iji comp^sons . 
done in 4» miUtary training cout^, achievement in individualized codrscs 
was equal to that ot convcational courses in 32 cases, superior in 15 cases, ap.d 
slightly poorer in only one caise (Orlansky & String, 1979). 
The general rule is that when self-pacing' is used to deliver poor tra(Qing 
materials.or when self.pacing is implemented poorly, then poor trammg 
results. The same is true of any other method of 'delivery. , • 

PERCEPTION: Self-pacing is responsible for the poor-quality of kraduates^from such courses 
PERCEPTION.^ Propulsion- Engineering, Jladioman "A", Basic Electncity/Electromo 

(BE/E). ' 

REALITY: Self-pacing tias been blamed for the>or quaUty of several Navy training 
REALp^Y. ^^^P^^ 8^ ^^^^^^ ^^^^^^ ,^ ^^^j ^jp^^ self-p?c«5g, but some 

other combination of factors such as poor training materials, sloppy imple- 
mentation of the training program, or failure to prepare instructors to minage 
student learning. In the next,few paragraphs, the real situations surrounding 
some Navy courses are discussed. * . 
PropoLrton Engineering: / f. ^ 

The Propulsion Engineering curriculum b a case in point. The original course 
'was carefully designed. While it ^as individuali2ed. it was designed for heavy 
instructor management, and waj in fact managed by instructors tiirough mid- 
1977 During that period, student achievement and instructor and student 
' ' satisfaction with tht course were good. Then, in 1977, a decision was made to 
shift test scoring and student pro^ management to the Navys C^U 
. • ^Computer-Managed Instruction) system. ^ . . * 

At the time of this m'odification, the Commanding Officer of the ^PE School 
requested NPRDC to conduct an experimental comparison of the, instructor- 
managed, and computer-managed versions of the course. The study tvas begun 
■ in December 1976 and cootinu»d through January 1978. Results of the study 
were .documented in a Letter RVport to the Chief of Naval Technical Train-, 
ing in September, 1978. The study showed that (1) training time wis tooger 
for the existing form of CMI managements (2) comprehensive , test gerfor- 
. mance was slightly lower for CMI students, and (3) module test performance 
"'was essKtially equivalent for both computer and instructor management.- 
However interviews with CMI instructors and support personnel revealed a 
pervasive dissatisfaction with CMI. Instructors felt that they did not have 
enough interaction with individual students under CMI, and 'therefore were 
not aware of students' academic pt'oblems. They, had more contact under 
instructor management because they individually scored "^h students 
module tests. Results also indicated no diffetennes in Instructor-studcnt 
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^ ' • • J i 

.n^tios, but differences in iastructors* time qllocation.^ 

Both versionsof the course used the same course materials and tests; the only 
difference wS^m the method of manageraent of .the individualized course. 
The results indicate , that the advantages of self-pacing can be obscured by the 
method used to manage student progress. • . • " 

Radioman 'A' School: 

The Radioman "AT course has been a comedy of errors since it's revision 
began in 1977. The Navy chose this course as the first eout^ to use new ISD . 
devetC^mcst metbcd:. U^fortussttly, Xhr- ISP nft'^thod? thprnvJves had . 
received no careful test for utility or adequacy, the ISb te^m was staffed, 
with people who had little experien* either with ISD or with the Radioman 
rate. The Fleet chose not td support the effort with an adequate supp^ of 
^subject matter experts. Th^ result was a poor course; it would have been 
poor regardless of the rpethod of delivery. ' 

Some evidence of the lack of quality comes from a recpnt effort by Stem and 
Fredericks (1982). They evaluated a module of the. Radioman "A" course that 
had just 'been redone using- ISD pr^dures. The lessons were to train people - . 
how to verify the correctness of messages typed on a form to be read by an 
optical character reader. Stydents were having problems learning from the 
lessons and instructors suggested tjiat they needed revision. The main consti- 
tuents of instruction, i.e., objectives," tests and learning materiab, were'found 
to be flawed even after revision according to ISD procedures. Some objectives 
were not related cloSfcly to the jjcrformance or knowledge required by the . 
job. Testing did not always measure the perfornlance or .knowledge as 
specified iji the t)bjectives. Instruction was often not geared to the objectives 
or to the tests, and, as a result, was often confusing aqd otherwise inade- 
, quate.' ' 

Tfie conclusioa bom this study and other analj'scs of the adequacy of Radio- 
man course materials is that poor instructional design and development is • 
responsible for inadequate st^dent performance/not the course's method of 
delivery. \ . 

Basic Electricity and Elettronlcs: 

■ The Basic Electricity and felectronics (BE/E) course was- never designed care- 
fully from its inception. Through the 195Cs and 60s> Navy electrpnics training 
was both extensive and theory and math intensive. WeU .qualified trainees 
were -amply available., thanks in part to the draft.' "A" School electrpnics 
courses, often eight ^months long, chaUenged the trainee^ and also prepared, 
them for the rigors of the "B-schools. 'B" schqols of up to fifteen, months 

' were available to qualifieJ re-crilistees. These -schools resembled university 
•engineering programs. ^ " , ^ 

Perhaps it wa4 inevitable that two do2en or more schools aroun^ the country* 
independently teaching the same content would generate pressure for consoli- 
dation. In the early 1960s, consolidations were carried out, and a common 
syllabus, based on Bureau of Personnel publications, was adopted at each of 
the major training centers. *^ ,^ 
Two factors which came info play in the 1960s and* 70s resulted in major 
changes In Navy electronics training. First,* the Programmed Instruction (PI) 
movement reached its peak of popularity in the 60s. Evaluation of this 
approach ih the Navy was judged desirable, and a contractor (Westinghouse) 
was funded by the Bureau of Personnel to convert the basic or intiroductory 
portion of Elegtricity/Electronics courses jnto a self-teaching formA. The 
contractor's charter was not to change the sjibstance of the course, but rather 
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• c _ tp'convett it into a c^ifferent "delivery system.' VVith the assistance of a com- 

■ mittee of E/E instructors from San Diego schjools, the. basic lectures of the 
Supers syllajjus were converted .into narrative and PI ma'terials, summaries 
*were wdtt'jh, test ii-ms were inserted ^as progress checks, and module tests, 

. . midterms, and final exams .were also prepare from existing. test items. The 

project*was expected to be an experimental comparisoD of three* different 
self -study formats,, narrative, programmed • instruetion, and sound-slide. It 
^ appears that the project fan out of support: only a few locally producc<| 

\ . -sound-slide materials evcr'^ppeared. The comparative evaluation,' if com- 
\ pleted/ was not published. Nevcrt'hcles$,"i|i 1963, a partially self -paced 

* \, compromise version of several variations of 'bstructpr-taught basic E/E was 
offered', a. ' % • . 

Second, in 1967, NPRDC (tjhin NFTRL) anB^CNATECHTI^ began work on 
• _ . a computct-managed instractiph (CMI) system. The course selected for t>U 

project the Westinghouse conversion of the basic' E/E coxirse. V/hh 
minor modifications* it -was on-line at NAS Memphis as a Cm courw in 1973. 
^ Again, however, the course was not systematically redesigned. 

A major' orMni2ational*change also infl?ienoed BE/E training. Following 
• ' • ^ r^cbmmendatms'of 'theCagleBoard, control of technical training was moved 

from BuPers in 197?, and vested in two new organizations, CNET and CNTT, 
\ with the latter, absorbing the functions of CNA'TECHTRA. These ne^ 
■ > organization evMuated the CMI course and concluded that this form' of 
^raining;could be' effective and economical. ^ CNTT in-house group (MHS A)- 
- was citatecVto improve and expand the CMI software. Basic E/E was consoli- 
y • ♦ - dated in four schools and 'incorporates into the CMI system. In 1975, the 

' . ■ Westinghouse. version of the S"an Diego compromise of the BuPers version of 

' ■ - Basic E/E was standardized tiiroughout the Navy. Sines 1975, while there 

' have been cosmetic changes to t^e dburse material, the only substantive 
* ' ' ^ ' modifications have been to Incrcas^ the CMI system's ability to output various 

' ' summaryreports,.toeliminatesome''nice'to-know'' material, atyl to add some 
' ' mddules on newer technologies such , as transistors, the current self-study 

niaUrias were recently edited to make them more consistent and reada1)le. 

■ Fundamentally, however, BE/E tod ay is the product of mandated 'time reduc- 
tionJ, consolidations, and changes in management and deliveryi all of which 
took place without course redevelopment. 

A ' Another' organizational change, occurring early in the 1970s, was the elimio^ 

^-j;;^ tion of the "B* schools. Also during the 7Cs there. was increased reliance on 
"""X--^-^ specific equipment schools, probably b|;cause of the accelerating acquisi- 
_ y tion of nwny new weapons systems. ^ 

In summary, the ciirrent Basic E/E course materials orjijinated with WW E 
electronics training several technological genefations^^i^. Today; we have a 
reasonable management system (CMI), a questio^le delivery system (PI), 
and a subject matter which date^^back to 1952- if not earlier, with which to 
^ conduct the initial conceptual training of all the electronics technicians 
needed in the 1980s.^ We have*a course originally intended to, provide 8 to 16 
' moaths of electronic instruction to very well-qualified students, which is now 
^ , ' d5livered to current recruits in alfSut 30 day*. Further, current instructors 

are graduates of this training, not the intensive training of a generation ago, 
and these inftructors receive no special preparation for managing.this peculi^ 
course. ' . . 
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' In general, then, there is a curriculum problem, not a scI^pacmg problem 
BE/E No job or task analysis was ever performed; instead, materials on cfcc- 
tromcs were adopted Irom very old courses,. There arc known ifladequacies 
in the ctursc, including poor instructional design, ajj{4 tests which can be 
answered without knowing th« content, or anft^ered correctly on the basis of 

' incorrect knowledge. Students do not j^em to develop a gdod conceptual 
understanding of electronics fundamentals in the short tinie available. It is 
USely that repair of this course will require lengthening it, with greater con- 
centration on the conceptual foundations of electronics. It is unlikely that 
^i,^,n«ir.o onlv th.» method of delivery of the current course will result in any 
significant improvement. 

PERCEPTION: Self-pacing eliminates the need for instructors. 

REALITY! One may find examples of very bright and highly motivated ^avy students 
pertormiccg well without an instructor, but this ia certainly not a gencraluable 
rule. Instructors' s'-auld pUy ati important role in •self-paced." instruction, 
and aotually should pace it thtfmstlves. They should closely monitor each 
studeixf 5 progress^ develop remedial materials, and give remediation to stu- 
dents^ who are having problems. Unfortunately, one of the problems with 
implShenting sclf-pacing in the Nivy ha3 been the ai-defia^;roIe of the ' 
instrticton. ' Often instructors in self -parted courses see themselves as little 
.more than paper pushers. A good exaWlc o« ^ ^is is the PE course discussed 
earUcr-. Wlien the course was instructor managed, instructor morale was good 
• and the^nstructors were very involved with their students. Wheh the com- 
puter took over scoring the. tests and providing remediation instructor morale 
' dropped. The amount of time they spent interacting witd students also 
dropped.' TJlifrcguld have been avoided by by better defining the instructor's • 
role in the CMI environmeht. 
^ ■ ■ ' ' 

PERCEPTION: Graduat^.of self-paced courses don't know 'theory.' 

REALITY: Graduates-of mos\ Navy,courses. not just self-paced ones, don't know theory. 

The reqson^is not that some courses are self-pated. 'but rastead, that the 
courses ^elselves do not teach the theory. NPRDC is currently engaged in 
■ ' dhalyzing the curricula for.a variety of l!(fvy courses to determine how often 
various types of learning requirements occur. For each course, each mdm- 
<iual learning objective is being categorizqd according to the type of mforma- 
tion it:require5 the student to learn. The 'findings so far are as follows: A 
• total of 9,208 objectives in 98 different courses (21 'A' and 77 'C or T'. 
schools) have been examined. (Only a few of these courses are self-paced.) 
These .objectives are taught to an aanual throughput of almost 63,000 stu- 
dents. Of these 9;208 objectives, only 584 or 63% require knowledge of 
theory. Thi rest require knowledge of equipment terminology, part^ names, 
controls, etc., or knowledge or performance of procedural adtions such as cal- 
culations, equipment start-up or shut-down, or preventive maintenance. 
' * fTtiZ reasons for this state of affairs are not simple, and have nothing to do 
with self-pacing. Instead, they have to do with shortfalls irixfunding for tram- 
ing. requirements to eliminate 'nice-to-know" information, and the inability 
/^of typical Navy or contractor instructional developers to analyze training 
\ requirements to identify needed, theory. • . 
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PERCEPTION: ISD always -results iij^^ self-paced cours*!! ' , 

REALITYf Self-pacing i"s.rio>'required la ISD. ISD evolved not as a specific tnethcd of 
teaching, but aj'a way to determint what trainees really nstjd to'bnow and to 
insure that tlieyleani it. With reference to training, ISD has two major goals: ' \. 
, to. make twining (1) job-relsvant (meaaing it would ultimately prepare the 
trainee for his or her function(s) in Navy" readiness), anil (2) cost-effective ^ 

I and cffidient (meaning it would use the most effici<{nt training methods to jo 

the training). With regard to the management'of the development of instpic- 
tionak programs, ISD has the' goal of making the prdcess more efficient and * ^ 
less haphazard and providing a basis for controlling and evaluating changes. ' 
It is important to understand these training and management goals because 
people have often confused ISD wifh particular teaching techniques. The ISD "^^w^^. 
process- is a means for defining* training goals, deciding uppn the best means of 
achieving them within rcsourcf constraints, and providing evaluation of the ^ 
program. In theory, any method o^ presentatioh (traditional, individualized,*. 
, self-Mced, or computer-managed) could be chosen, depending upon its feaii- . 

bilt<y. In practice, the preferr'ed method is fften some form of individualiza- ; , j 
tion, because it has b^en >hown to be more efficient since it takes advantage 
of the fact tl^t people Ica.n at different rates (Branson, Rayner, Cox, Fur- 
man, King, & Hanium, .1975). There are a number of questions- which * 
research can help answer-about how to implement various types of individu- 
^ ' alized instruction and whether they are effective for all, trainfees. 

• PERCEPTION: Traditional lockstep instructional delivery results la better learning and per- ^ 
formancet . • . . #• 

REALITY: ' Even with the advent of ISD developing and delivering tostructional programs , 
depend very heavily on, the expertise of the people doing the development. ^ 
and delivery. Instructional design is still to some degree an intuitive process. 
Self -paced instruction which is carefully developed solves this problem in'part 
by standardizifry the instruction. That is, all students receiye the same. con- 
tent'. (Of course if the content is bad then a problem still exists). With the . 
' traditional approach the content is often left. up to the individual ^stnictor. . * 
The problem "with this is that the intuitions of in^structofs about '^hat and ^ 
how to te^ch can vary widely. The resuHinjfpinstruction may then teach 
irrelevant things, or perhaps leaye^^^ttTthings very important to people's job 
performance. Thus, instability' or variability often occurs in the traditional 
instructional ^lo^^^r"^ * 

The proWemrthat can occur with traditional instruction are illustrated by a 
■ icjtnt^WRDC project (Van Kekerix, Wulfeck.& Montague, 1982). An exist- \ \ 
^-^Inii fairiy typical, Navy 'C schpol was converted to self-study. As part of that \ ' 
* ^ project data was collected on the efficiency and quality of the traditional 

^ course before, any intervention. 

NPrtDC personnel attended tw.o cycles of the course, and recorded student 
, engaged time and other observable behaviors found to be significantly related 
^ to the acqitisition and' retention of learning (Li«nliardt, 1977; Coolcy & 
Lienhardt, 1978; Stalling 1973; Cooley & Lohnes, 1976; Berliner & Rosenshine, _ 
1977', Dunkin, 1978; Slayin, 1980; McKenzts & Henry, 1979; Evcrtson & Veld- ^ 
man, 1981). Seven students were enrolled in the course during 'these tw« . 
cycles, three in one, and four in the other.. The data collected Jncjiided meas- 
ures of student time spent in lectures, laboratory exercises, performance tests, 
breaks, and ifii the laboratory but not actually performing'-an exercise. (Only 
one system was available in the laboratory, so students often had to wait for 
others to complete their lab assignment or performance test.) Student 
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administrative-dutiv, such as visits to the personnel office, werfc not included 
as breaks, but were incladed in total day^ enrolled in the course. 
In geheral.th«»,data' indicate that the brfginal course was inefficient. First.- 
'instructors were able to deliver instructional content for less than half the 
X«ed time. Second.. the group-pacing of the course led to inefficient use of 
Sag equipment. This occurred because-oaly two students could Work on a 
S^ probkm while their- clas^^^^ Therefore bboratory 

equYpment was undej-utilized dutrlng lectures, while queuing resulted during „ 
laboratorv performance period.. . Third students did not spend much of their 
available Jimex)a'-task. 7 

The two Instrvctor/Subject Matter Experts assigned. to the course attendpd ati 
Instructional Qualiiy Inventory (IQO Workshop to learn IQI ^jalytic tech- 
I niques. (The IQI i^ described in Wulfeck. Ellis, Richards, Wood. & McmU. 
^" 1978.) They then performed twd IQI analyse* of^tbe course matenaMl) the 
ouri iSJning and' enabUni objectives were classified i^to TaskyConten 
categories, and (2) the various instructional materials were rated on the bas^s 
of adequacy of their coverage of, ^he-learning specified m the objectives. The 
analyses identified the following deficiencies: 

1. The objectives over-emphasized remembering informat-on. ^ 

2. No written test materials were avai4tt»le. ' , 
' • 1 Many more study questions were needed. 

4 Thd instructional materials covering use of. the Technical Manual 
were incotnple'te. and provided no practice in using the special features 
of that manual. . ^ 

The point of all this is that traditional deUvery is no guarantee of instruc- 
tional quality or training efficiency. 

PERCEFTION: A poor-quallty-^ced course can be ;csurrfccted^^^fifplr«)rconvertingl^ • 

"lofikstep* dpliveryT^ . , 

REALITY: It should be clear that becaule^a^prqbl^ms with self-paced Navy cou^s are 
REALITY. i ^^^^ 5clf-pacing>^^ (b) traditional dcUvery^do^ 

Z always r<fsult in quality, that wholesale co^fivec^ibn of '^^'P;^^'^ 
traditional delivery is not likely to improve those coupes, " j^r^"}'";"!^ 
revisions are made, then conversion will .most probably result m a further 
decrement in quality whUejhe .courses are perturbed. 
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Conclaslon 

. In this paper, we have tried to make the following points. 
\. Self-pacing 1$ misunderstood. ' ' ' 

2. Self-pacing is not the only factor respons^^^e for perceived declines in the quality 

of Navy training, and may not be involved at all. 
3 Naw training cqurses have mofe serious problems than their method of delivery. In 
^' ?a^how?coaL is taught is quite a way down on the list <>^<^Jf ^^^^ //^^^^^^^^ 
/ment concerns. The most important Issues ate. (1) is the nght knowledge/skil 
bcin« taught, (2) is the quaUty of thfc insthictifn and test items sufficient. ac« (3) 
. LTth Xt v". test i?ems and instruction all consistent with one another. How 
Te instruction is presented is not as serious a concern and is o6ten decide* 
economically rather than p^edagogically. 
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4. Traditional delivery methods will not guarantee instructional quality. 

5. Ail forms of delivery, including self-pacing, have .advantages and disadvantages that 
involve complicated trade-offs. . ' 

6. There are no simple solutions to the problems of Navy training. 

* In conclusion, it is- time to recognize that training systems are no less complex' than 
moderti weapons* systems. Like hardware systems, training systems rew,uire the same careful 
research, development, test, and evaluation during their initiation, Jid the same kind of 
attention to preventive and correcti/C maintenance and life-cycle support. 



Recommendation 

The" Chipf of Naval Educauon and Training in a letter tp all Commanding Officers in 

the Naval Education and Training Command said: 

^e all must step back and take a close look at what is going on in our classrooms. It b 
'.not enough to know whether it i^ lockstep, self -paced, CMI or one-on-one laboratory 
instruction. We need td assure ourselves that the^ teaching and learning going on ^t the 
classr<^m level is of the quality required to produce well-trained sailors. If it isn't, then 
we zj\ need to work together to make it so." ^ . 

He further stated: 

* 1 am confident that promising techniques and new technologies dp have a major role to 
play in support of instruction. But there must be more controlled test and evaluation 
which spell* Put accompanying training reguirements and which develops specific dpcu- 
' mentation showing that cost and learning effectiveness standards have been met." 
This guidance for how to proceed is well reasoned. Any attempt to effect major changes in 
existing instructional systems Without the controlled test and evaluation called for by CNET 
wocild be both reckless and cottly. Specifically, changing a course f:rom 4ock$tep to self-paced 
or vice versa without sufficient evidehce that the quaUty of the lastruction will improve 
and/or significant cost savings will occur would be counter to CNET's reasoned guidance. 
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